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Abstract 

A definite Horn theory is a set of n-dimensional Boolean vectors whose char¬ 
acteristic fnnction is expressible as a dehnite Horn formula, that is, as con¬ 
junction of dehnite Horn clauses. The class of dehnite Horn theories is known 
to be learnable under diherent query learning settings, such as learning from 
membership and equivalence queries or learning from entailment. We pro¬ 
pose yet a diherent type of query: the closure query. Closure queries are a 
natural extension of membership queries and also a variant, appropriate in 
the context of dehnite Horn formulas, of the so-called correction queries. We 
present an algorithm that learns conjunctions of dehnite Horn clauses in poly¬ 
nomial time, using closure and equivalence queries, and show how it relates 
to the canonical Guigues-Duquenne basis for implicational systems. We also 
show how the diherent query models mentioned relate to each other by either 
showing full-hedged reductions by means of query simulation (where possi¬ 
ble), or by showing their connections in the context of particular algorithms 
that use them for learning dehnite Horn formulas. 
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1. Introduction 

Query Learning [l| is one of the most well-known and studied theoreti¬ 
cal learning models available. According to this model, a learning agent or 
algorithm interacts with the world by asking questions (that is, queries) to 
one or several oracles that reveal partial information about an unknown but 
previously fixed concept (the target). Learning is achieved when the learning 
agent outputs a representation of the unknown concept. Naturally, as it is 
customary in a computational context, the number of queries that the algo¬ 
rithms need to make in order to learn is a resource that one needs to account 
for and restrict; efficient algorithms in the Query Learning context should 
address to the oracle a polynomial amount of queries. Finally, a concept 
class is said to be learnable within a query learning model if there exists an 
algorithm that, by asking a polynomial number of its available queries, is 
able to discover any previously fixed concept from the concept class. 

Query Learning thus deals with determining learnability of different con¬ 
cept classes under different variants of learning models (that is, with different 
query types). The more complex a concept class is, the more queries will in 
general be necessary to learn it. And one concept class m^ be learnable 
under a particular set of query types but not others (see e.g. for examples 
of this). Several extensions, of different focus and generality, appeared sub¬ 
sequently. One very general notion of query learning is that of |3|; in a less 
general level, some of these different extensions are of interest for this paper. 

In this paper, we focus our attention to the class of (propositional) def¬ 
inite Horn formulas. The seminal paper by Angluin, Frazier and Pitt 
established that this class is indeed query learnabl^. The types of queries 
that they allowed are the most commonly used in query learning [l|: stan¬ 
dard membership queries (SMQs) and standard equivalence queries (SEQs). 
In an SMQ, the algorithm asks whether a particular example (a truth assign¬ 
ment in our case) belongs to the unknown target concept, and the answer 
it receives is YES if the assignment is satisfied and NO otherwise. In an 
SEQ, the algorithm asks whether a particular Horn formula (the hypothesis) 
is semantically equivalent to the target formula, and the answer it receives 


^To be more precise, their algorithm learns the more general class of Horn formulas. 
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is YES if it is indeed so and NO otherwise. In the case of a negative answer, 
a counterexample is provided, that is, an assignment that is satished by the 
target but not by the hypothesis or vice versa. The counterexample is then 
used by the algorithm to refine its hypothesis and learning continues. 

Since the introduction of the first query learning models [ij, several fur¬ 
ther variants of query types have been introduced and studied. One is the 
family of Unspecified Attribute Value queries j^, the query-learning parallel 


to the Restricted Focus of Attention extension to the PAG model [6|. Its key 
traits are the context of n-dimensional Boolean vectors (for fixed n) and the 
ability to handle each dimension somehow “individually”, by means of the use 
of “don’t-care” symbols to allow the query to focus on specihc dimensions. 

A second variant, also working on n-dimensional Boolean vectors but 
moving to a slightly more abstract notion of query, is proposed in [^: the 
entailment query, where simple formulas (in that concrete case, Horn clauses) 
play the role of individual examples. In this protocol, in an entailment mem¬ 
bership query (EMQ) the learner proposes a Horn clause and receives, as 
answer, a Boolean value indicating whether it is entailed by the target, seen 
as a propositional (in that case, Horn) formula. Similarly, in the entailment 
equivalence query (EEQ), a Horn formula is proposed and, in case of a neg¬ 
ative answer, the provided counterexample is a Horn clause that is entailed 
by exactly one of the two formulas, the target and the query. 

Yet a different variant of entailment query is employed in for the al¬ 
gorithm known as Attribute Exploration, also in a context very similar to 
learning Horn clauses. This is a protocol where the query is an implication, 
that is, a conjunction of clauses sharing the same antecedent; the main differ¬ 
ence is as follows: one gets as answer either YES if the implication is entailed 
by the target, or a counterexample that satisfies the target but not the im¬ 
plication. Thus, this variant is midway through between plain entailment 
membership, to which it resembles most, and standard equivalence, because 
a counterexample assignment is received in the negative case. 

Finally, in j9l.ll0l . llll . ll2 , we hnd a different extension: Correction Queries, 
which model a very intuitive idea from linguistics: instead of a simple NO 
answer as in the case of SMQs, the teacher provides a “correction”, that is, 
an element of the target language at minimum distance from the queried 
example. 

One must note that, whereas several positive results prove that the avail¬ 
ability of certain query combinations allows for polynomial-time learnability, 
there are negative results that show that many representation classes are im- 
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possible to learn from polynomially many individnal queries like membership 
or equivalence [H, . 

This paper’s contributions are two-fold. First, we propose a quite natu¬ 
ral notion of closure query (CQ) and a polynomial time learning algorithm 
for definite Horn Boolean functions via equivalence and closure queries; it is 
closely related to the algorithms in and j^. The second part of the paper 
studies the relationships between our newly introduced closure query model 
and other well-known query models. While some of the relationships are 
already known (and these are duly noted), we obtain interesting new ones. 
More precisely, our algorithm yields back, through a quite intuitive transfor¬ 
mation, the algorithm for Learning from Entailment [7|. Additionally, as we 
shall see as well, also the celebrated algorithm to learn definite Horn theo¬ 
ries from membership and equivalence queries of can be related to this 
approach, in that the usage it makes of positive examples can be understood 
as progressing towards the identihcation of unavailable closures. We believe 
that these connections we develop provide insight, and also help in estab¬ 
lishing an overview of the strengths and weaknesses of all the variants under 
study. In addition to the relation of the learning algorithm proposed in the 
first half of the paper to these already existing variants, further relationships 
between models are shown to be possible in the more general form of query 
simulation. 

Closure queries share a number of traits with each of the query models 
discussed before. Under a natural notion of “correcting upwards” (see below 
for precise definitions), in the context of a definite Horn target, the closest 
correction to a negative example is exactly its closure under the target. Thus, 
we hnd a variant of correction query for definite Horn targets that allows for 
(limited) manipulation of individual dimensions of the Boolean hypercube, 
as do the other query models we have mentioned, and provides an expla¬ 
nation of “what are we looking for” along both the processes of entailment 
queries and the positive examples of the learning algorithm from membership 
and equivalence queries. Our advances are based on the novel view on Horn 


learning via queries deployed more recently in [13|, . The introduction of 


the closure query is, in fact, motivated by these two panders in the following 
sense: the main aim in revisiting the original algorithm was to improve on 
its query complexity. This objective is still unfulhlled; however, we believe 
that the closure query provides the “right amount” of expressiveness and 
information to the algorithm in order to capture the essence of difficulty in 
learning, while at the same time making some of the book-keeping details 
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easier to deal with. Thus, working with the closure query model, we be¬ 
lieve that we are in a better position to answer the fundamental question of 
whether the original algorithms of j^, are indeed optimal or can otherwise 
be improved upon. 

2. Preliminaries 

We work within the standard framework in propositional logic, where one 
is given an indexable set of propositional variables of cardinality n. Boolean 
functions are subsets of the Boolean hypercube {0,1}"', and these functions 
are represented by logical formulas over the variable set in the standard way. 
Binary strings of length n assign a Boolean value for each variable, and are 
therefore called assignments; given any Boolean function or formula H, the 
fact that assignment x makes it true (or “satishes” it) is denoted x \= H. 
Following the standard overloading of the operator, H \= H' means that, 
for every assignment x, ii x \= H then x \= H'. Assignments are partially 
ordered bitwise according to 0 < 1 (the usual partial order of the hypercube); 
the notation \s x <y. 

A literal is a variable or its negation. A conjunction of literals is a term, 
and if none of the literals appears negated it is a positive term, also often 
referred to as a monotone term or monotone conjunction. We often iden¬ 
tify positive terms and mere sets of variables; in fact, we switch back and 
forth between set-based notation and assignments. We denote variables with 
letters from the beginning of the alphabet {a,b,c, ..), terms, or equivalently 
subsets of variables, with Greek letters (a,/3,..) and assignments with letters 
from the end of the alphabet {x,y,z,..). We may abuse notation at times 
and it should be understood that if we use a subset a when an assignment 
is expected, it is to be interpreted as the assignment that sets to 1 exactly 
those variables in a. We denote this explicitly when necessary by x = [a]. 
Similarly, if we use an assignment x where a subset of variables is expected, 
it is to be understood that we mean the set of variables that are set to 1 in 
X. We denote this explicitly by a = [x\. Clearly, we have a bijection between 
sets of propositional variables and assignments, and x = [[x]] and a = [[a]] 
for all assignments x and variable sets a. 

2.1. Horn Logic 

In this paper we are only concerned with definite Horn functions, and 
their representations using conjunctive normal form (CNF). A Horn CNF 
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formula is a conjunction of Horn clauses. A clause is a disjunction of literals. 
A clause is definite Horn if it contains exactly one positive literal, and it is 
negative if all its literals are negative. A clause is Horn if it is either definite 
Horn or negative. 

Horn clauses are generally viewed as implications where the negative lit¬ 
erals form the antecedent of the implication (a positive term), and the sin¬ 
gleton consisting of the positive literal, if it exists, forms the consequent of 
the clause. As just indicated, along this paper it will always exist. 

An implication a ^ fi, where both a and fi are sets of propositional 
variables with a possibly empty, but not /3, is to be interpreted as the con¬ 
junction of dehnite Horn clauses Abe/? ^ b. A semantically equivalent 
interpretation is to see both sets of variables a and fi as positive terms; the 
Horn formula in its standard form is obtained by distributivity over the vari¬ 
ables oi fi. Of course, any result that holds for Horn formulas in implicational 
form with no other restrictions also holds for the clausal representation un¬ 
less it explicitly depends of the implications proper, such as counting the 
number of implications, as we will do below. Furthermore, we often use sets 
to denote conjunctions, as we do with positive terms, also at other levels: 
a generic (implicational) CNF Ai(®* /^*) is often denoted in this text by 

{(ofi —)■ /9j)}i. Parentheses are mostly optional and generally used for ease of 
reading. 

An assignment x G {0,1}” satishes the implication a —/9, denoted 
x 1= a —?> /3, if it either falsihes the antecedent or satishes the consequent, 
that is, X ^ a or X 1= /3 respectively, where now we are interpreting both a 



Theorem 1 ([l5[ [l^ l3|)- A Boolean function admits a Horn CNF repre¬ 
sentation if and only if the set of assignments that satisfy it is closed under 
bit-wise intersection. 


A Horn function admits several syntactically different Horn CNF rep¬ 
resentations; in this case, we say that these representations are equivalent. 
Such representations are also known as bases for the Boolean function they 
represent. The size of a Horn function is the minimum number of clauses 
that a Horn CNF representing it must have. The implication size of a Horn 
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function is defined analogously, but allowing formulas to have implications 
instead of clauses. Clearly, every definite clause can be phrased as an impli¬ 
cation, and thus the implication size of a given Horn function is always at 
most that of its standard size as measured in the number of clauses. 

Horn CNF representations may as well include unnecessary implications. 
We will need to take this into account: an implication or clause in a Horn 
CNF H is redundant if it can be removed from H without changing the Horn 
function represented. A Horn CNF is irredundant or irreducible if it does 
not contain any redundant implication or clause. Notice that an irredundant 
H may still contain other sorts of redundancies, such as implications with 
consequents larger than strictly necessary. 

2.2. Closure Operator and Equivalence Classes 

We will employ the well-known method of forward chaining for dehnite 
Horn functions; see e.g. [l^. Given a dehnite Horn CNF H = {oj —>■ /3j}j 
and an initial subset of propositional variables a, we can construct a chain 
of subsets of propositional variables by successively adding right-hand sides 
of implications, provided that the corresponding left-hand side is already 
contained in the current subset. Given a set of variables a, the maximal 
outcome of this process is denoted a*, and contains all the variables “implied” 
by the set of variables a. As it is well-known, a* is well-dehned, and only 
depends on the Boolean function represented by H, not on the representation 
H itself. The corresponding process on assignments provides the analogous 
operator x*. 

Note that the closure operator is dehned with respect to a function which 
is not explicitly included in the notation x*. It should be clear from the text, 
however, with respect to what function the closure is taken. 

It is easy to see that the * operator is extensive (that is, x < x* and 
^ ct*), monotonic {ii x < y then x* < y*, and if a C /3 then a* C f3*) and 
idempotent {x** = x*, and a** = a*) for all assignments x, y and variable 
sets q:,/ 9; that is, is a closure operator. Thus, we refer to x* as the closure 
of X w.r.t. a definite Horn function /. An assignment x is said to be closed iff 
X* = X, and similarly for variable sets. The following holds for every definite 
Horn function / (see Theorem 3 in H): 

Proposition 2 ([l^). Let f be a definite Horn function; let ex be an arbitrary 
variable subset, b any variable and x an arbitrary assignment. Then, 

1. f \= a ^ b if and only if b E a*. 
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2 . X = X* if and only if x |= f, 

3. X* = /\{y \ X <y and y \= f}, 

Therefore, / |= [y] — )■ [?/*] whenever the closure of y is computed with 
respect to /. Moreover, for any assignment x, there is a uniquely dehned 
assignment y evaluated positively by / with y bitwise minimal such that 
X < y, namely, y = x*. 

For a hxed function /, this closure operator induces a partition over 
the set of assignments {0,1}"' in the following straightforward way: two 
assignments x and y belong to the same class if x* = ?/*, where both closures 
are taken w.r.t. /. This notion of equivalence class carries over as expected 
to the power set of propositional variables: the subsets a and fd belong to the 
same class if a* = (d*. It is worth noting that each equivalence class consists 
of a possibly empty set of assignments that are not closed and a single closed 
set, its representative. 

Furthermore, the notion of equivalence classes carries over to implications 
by identifying an implication with its antecedent. Thus, two implications 
belong to the same class if their antecedents have the same closure (w.r.t. a 
hxed /). Thus, the class of an implication a ^ (d is, essentially, a*. 

Example 1. This example is taken from 0/. Let H = {e —?■ d, 6c —?■ 
d,bd c,cd ^ b,ad —?■ bce,ce —?■ ab}. Thus, the propositional variables 
are a,b,c,d,e, f. The following table illustrates the partition induced by the 
equivalence classes on the implications of H, where closures are taken with 
respect to H itself. The first column is the implication identifier, the second 
column is the implication itself, and the third column corresponds to the class 
of the implication. As one can see, there are three equivalence classes: one 
containing the first implication, another one containing implications 2, 3, 
and 4; and a final one containing implications 5 and 6. 


1 

e —)• d 

ed 

2 

be ^ d 

bed 

3 

bd ^ c 

bed 

4 

cd ^ b 

bed 

5 

ad —bee 

abede 

6 

ee ab 

abede 


2.3. A Related Closure Operator 

Now we proceed to dehne another important operator which is similar in 
havor to the closure operator -k seen above. 
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Let H be any definite Horn CNF, and a any variable snbset. Let H{a) be 
those implications of H whose antecedents fall in the same equivalence class 
as a, namely, H{a) = {«* —)■ /dj | a, —)■ /dj G iL and «* = «*}. The closure is 
taken with respect to H itself. 

Given a definite Horn CNF H and a variable subset a, we introduce a 
new operator • 1^, l20|, l2l| that we define as follows: a* is the closure of 
a with respect to the subset of implications H \ H{a). That is, in order to 
compute a* one does forward chaining starting with a but one is not allowed 
to use implications in H{a). 


Example 2. Let H = {a —)■ 6, a ^ c, c —)■ d}. Then, (ac)* = abed but 
(ac)* = acd since H{ac) = {a —)■ 6, a —)■ c} and we are only allowed to use 
the implication c ^ d when computing (ac)*. 


This new operator is, in fact, a closure operator, well-known in the field 
of Formal Concept Analysis; there, assignments that are closed with respect 
to it are sometimes called quasi-closed. 


2 . 4 . Saturation and the Guigues-Duquenne Basis 

In this section we review briefly part of our results from our previous work 
. We will skip many details as they can be found in the aforementioned 


14 


article. These results are, in fact, an interpretation of the work of [21 


which were stated in the context of formal concepts, closure systems and 
lattices. 

We say that an implication a ^ of a definite Horn CNF H is 


• left-saturated ii a = a* (the quasi-closure is taken with respect to H) 

• right-saturated if (4 = a* (the closure is taken with respect to H) 

• saturated if it is both left and right-saturated (the closure is taken with 
respect to H) 


Then, a definite Horn CNF is saturated if all of its implications are. 
Moreover, any saturated definite Horn CNF must be irredundant (see Lemma 


2 of 1^ for a proof). A result from 1^, l2]| states that 


Theorem 3 ([l^, ^). Definite Horn functions have at most one satu¬ 
rated basis, which is of minimum implicational size. This basis is called 
the Guigues-Duquenne (GD) basis. 
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See [l^ for additional discussion. In particular, there we show that the 


GD basis of a given dehnite Horn CNF representation can be computed with 
the following procedure: using forward chaining, right-saturate every clause. 
Then, use forward chaining again to compute the left-saturation of the left 
hand sides of the implications using the information on the equivalence classes 
of the existing implications to do the left-saturation properly. Finally, remove 
all those clauses that are redundant. 


2.5. Closure Queries 

The above leads naturally to a clear notion of closure query (CQ): 

Definition 1. For a fixed definite Horn formula T on n propositional vari¬ 
ables and given n-hit vector y, the answer to a closure query on input y is y*, 
that is, the closure of y with respect to T. 


This query can be seen as a natural variant of correction query: under 
the condition that all corrections are “upwards”, namely, that they are al¬ 
lowed only to change a zero into a one. Proposition [2] tells us that, for every 
assignment y that is negative for T, there is a unique “closest” correction 
query, and it is exactly y*, the closure of y with respect to T. 

Closure queries provide us with a way of correctly identifying right hand 
sides of implications in one shot, since saturated implications are always of 
the form [y] —)■ [y*]. We shall see in the next section that this is exploited 
during the learning process. 

An oracle answering closure queries can be implemented to run in linear 


time in |T| and n (see Theorem 2 of 14 


3. Learning Definite Horn Theories from Closure and Equivalence 

Queries 

As usual in Query Learning, a target dehnite Horn function T is hxed, 
and the learning algorithm interacts with an environment able to provide 
information about T in the form required by the corresponding query pro¬ 
tocol. In our case, this amounts to the learning algorithm being able to use 
at any time the closure y* of any Boolean vector y as necessary, as it can 
be obtained from a closure query (the closure is computed with respect to 
the target T). Equivalence queries (denoted as EQ{) in the algorithms) are 
used in the standard manner as control of termination: the algorithm £n- 
ishes exactly when the equivalence query receives a positive answer, which 
guarantees correctness provided that the algorithm is shown to terminate. 
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Theorem 4. Definite Horn formulas are learnable from equivalence and clo¬ 
sure queries in polynomial time. 

Proof. Each equivalence query will take the form of a hypothesis dehnite 
Horn formula hyp{N) based on a list of n-bit vectors iV; namely, it will be a 
conjunction of implications, dehned as follows: 

hyp{N) = /\[y]^ [y*] 

y&N 

In fact, as we shall see momentarily, N will be a list of negative examples, as 
usual in Horn clause learning. Clearly, given N, hyp{N) can be constructed 
easily using closure queries. 

We observe now that the combination of an inequality and a closure leads 
to a membership query: 2 ; is a negative example if and only ii z < z*, because 
always z < z*, and positive examples are exactly those that coincide with 
their closure, by Proposition |2l 

We combine these ingredients as described in Algorithm [1] which we will 
call CIH. The proof of its correctness is built out of the following two lemmas. 
These lemmas refer to the elements in N, the list of counterexamples, as 
2 / 1 , 2 / 2 , 2 / 3 , ■ ■ ■,y\N\- 

Lemma 5. T |= hyp{N), therefore counterexamples are always negative. 

Proof of Lemma\^ Take any assignment y. Since the closure y* is taken 
with respect to the theory T, we have that T |= [ 1 /] —)■ [y*] for every y and in 
particular all those y E N, and therefore, T |= l\y^j^[y] —)■ [ 2 /*] = hyp{N) as 
required. □ 

Lemma 6. For i < j, there is a positive z with yi A yj < z < yj, and, 
therefore, each yi violates different implications ofT. 

Proof of Lemma 0 We argue inductively along the successive updates of N. 
We need to establish the fact (1) at the time of appending a new element 
of N, and (2) we need to argue that rehnements to existing y E N that 
take place maintain the fact stated. We will show (2) in detail; (1) is proven 
similarly and so we omit the details. 

First note the easiest case whereby yi gets rehned into y'i = Vi A x. This 
leaves y^ untouched, and brings down A yj into y[ A yj] the same value 
of z, given by the induction hypothesis on y^, yj before the update, will do: 
y'i A yj <yiAyj<z< yj. 
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Now consider the case in which yj is rehned into ?/' = yj A x. We assume 
as inductive hypothesis that a corresponding z exists before the rehnement: 
ViAyj < z < yj. 

We establish hrst the following auxiliary claim; there is a positive example 
z' for which yi Ax < z' < x. To hnd such z' , observe that yi came before yj 
but was not chosen for rehnement; either Ax is itself positive, and we can 
simply choose z' = yi A x, or y^ < x. Since x was a negative counterexample, 
it must satisfy the query, so we have that x \= [yj\ -A [y*]] therefore y* < x 
since yi < x. We pick z' = y*, which is of course positive. 

At this point, we have the already existing z fulhlling yi A yj < z < yj, 
and the z' just explained for which y^ Ax < z' < x. Observe the following: 
yi A y'j = yi A yj A X = yi A yi A yj A X = {yi A yj) A {yi A x). The hrst half of 
this last expression is bounded above by z, and the second half is bounded 
above by z' , therefore yiAy'j < z A z' < yj Ax = y'j. Moreover, both 2 ; and z' 
being positive, and the target being closed under intersection, ensures that 
z Az' positive. 

The induction basis case of appending a new x to iV is handled in the 
same way: the positive z' obtained in the same manner fulhlls directly the 
condition yi A x < z' < x, which is what we need. 

Finally, the property that there exists a positive ^ s.t. yi A yj < z < 
yj for every i < j implies that each diherent yi,yj must falsify a diherent 
implication of the target T. Suppose otherwise by way of contradiction that 
both counterexamples are falsifying the same implication a ^ (3. Then, we 
would have that [a] < yi and [a] < yj so that [a] < yi A yj < z. Since 2 ; is 
positive, then z \= a ^ (3 and so [(3] < z < yj. Therefore yj \= a ^ (3 thus 
contradicting our assumption. □ 

To prove termination, it suffices to note that by the previous lemma, 
N cannot be longer than the number of implications in the target. After 
each iteration, either an existing counterexample decreases in at least one 
bit (which can happen at most n times for each existing counterexample), 
or a new one is added (which can happen at most m times, where m is the 
implication size of T). Hence, the total number of equivalence queries issued 
is at most nm + m + 1 = 0{nm). As to the number of closure queries, in 
each iteration we need to issue at most m queries when checking intersections 
with existing members of N, which makes a total of 0{m3n) closure queries. 
Notice that we could store and avoid the queries needed for building the 
hypothesis hyp{N) and therefore we do not need to account for the extra 
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m queries (which in any case does not affect the asymptotic of the query 
count). In terms of time, the outer loop is executed 0{mn) times, and each 
iteration has a cost of mn\ the factor m is due to looping over all yi G iV, 
and the factor n for the manipulations of vectors of length n, totaling a time 
complexit}@ of □ 


Algorithm 1 Learning from Closures Algorithm CIH 
1: N = [] // empty list 
2: while EQ{hyp{N)) = (NO,a;) do 
3: //we will show below that x is negative 

4: for yi G N, in order do 

5: y = X Ayi 

6: if 1/ < yi and y < y* then 

7: yi = y 

8 : break 

9: if no yi was changed then 

10: add X at the end of N 


3.1. The Horn Formula Obtained 

We prove now the main fact about algorithm CIH, characterizing its out¬ 
put. Most of the proof is discharged into the following technical lemma. 

Lemma 7. At the time of issuing the equivalence query, hyp{N) is left- 
saturated. 

Proof. For hyp{N) to be left-saturated it is enough to show that yi \= [yf -A 
[y*] whenever i ^ j since this implies that yi = y* or equivalently yi is closed 
with respect to H \ iL([?/*]), where H = hyp{N). 

In order to show that an arbitrary yi & N satisfies an arbitrary clause 
of [yf —)■ [y*] G hyp{N) whenever i ^ j, we proceed to show that yi > yj 
implies yi > y* and so the implication is necessarily satisfied. 

We assume, then, that yi > yj- li i < j, by Lemma |6] we know that 
yi A yj < z < yj, and so we have yj < z < yj which is impossible since all yj 


®This complexity depends on implementation details, but we assume these operations 
can be done in time linear with n, extra logarithmic factors could be hidden in a low-level 
implementation. 
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are negative and z is positive. Therefore, it must be the case that i > j and 
then Lemma E] guarantees that Uj f\yi = Uj < z < yi. Monotonicity of the 
closure operator implies that y* < and so y* < z since z* = z. Finally, 
yj^z<yi implies y* < yi as required. □ 

Theorem 8. The output of Algorithm CIH is the GD basis of the target. 

Proof. The output is the last hypothesis queried, which receives a positive 
answer. By the previous lemma, all the antecedents are left-saturated with 
respect to hyp{N); but, as the answer is positive, hyp{N) is equivalent to the 
target, hence all the antecedents are left-saturated with respect to the target. 
By construction, the right-hand sides of the queries are always closures under 
the target. Hence, the final query is a saturated definite Horn formula for 
the target. As we have indicated earlier, there is a single saturated dehnite 
Horn formula for any definite Horn theory: its GD basis. This is, therefore, 
the output of the algorithm. □ 


4. Relationships among Query Learning Models 


This section attempts to clarify the relationships between our algorithm 
and the previously_published versions that work under slightly different learn¬ 
ing models 0 , 0 , 13 . The original AFP algorithm 0, [3 works under what 
we will refer to as the Standard Query Model which uses standard equivalence 
queries (SEQs) and standard membership queries (SMQs). 

The algorithm LRN in 0] works under the Entailment Query Model 
which uses entailment membership queries (EMQs) and entailment equiv¬ 
alence queries (EEQs). Entailment queries are somewhat more sophisticate 
versions of the standard set-theoretic queries. In these queries, the role of 
assignments is played here by clauses. In the entailment setting, a member¬ 
ship query becomes a query to find out whether a concrete clause provided 
by the learner is entailed by the target. As in the set-theoretic setting, 
the equivalence query is a Horn formula, but the counterexample in case of 
nonequivalence is a clause that is entailed by exactly one of the two Horn 
formulas: the query and the target. This is, in fact, the major difference 
with set-theoretic queries: the entailment-based equivalence query does not 
return an n-bit vector but, instead, a clause. 

Generally speaking, there are two ways in which the relation between 
these algorithms becomes apparent: the first one being that some queries 
can be directly simulated by others, and so algorithms are the product of 
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reductions; but, also, there may be a way to specifically run simulations of 
one particular algorithm within another, even if the query protocol does not 
allow for direct simulation. 

This section is divided into two parts. The first part (Section 14.ip will 
show direct simulations of several types of queries by other query types. This 
type of reduction shows, in fact, the relationships among the three models 
considered (standard, entailment, and closure) independent of the algorithm 
employed. The second part (Section 14.2p shows executions of the actual 
algorithms that lead to similar behaviors in the sense of having identical 
evolution of intermediate hypotheses. 

4-1- Query Simulation 

In this section we discuss cases where queries of one type can be directly 
answered by (efficient) algorithms using another set of queries. In this case, 
an algorithm working under one model can be directly made to work under 
another model by using the appropriate query-answering algorithms as black 
boxes. These are, in fact, query model reductions. 

In the following subsections we will detail several of these reductions. In 
some cases we will see how we can simulate one type of query by its analogue 
under another model; in other cases, we may need both types of queries 
(membership and equivalence, for example) to be able to simulate another 
query. In our presentation, T stands for the target Horn function. 

4-1.1. Entailment Queries Simulate Closure, Standard Membership, and Stan¬ 
dard Equivalence Queries 

EMQ CQ. It is not hard to answer a CQ when EMQs are available. 
Given y, to construct y* (its closure with respect to T), we test, for each 
variable b not in [y], whether T \= [y] —)■ 6 by means of EMQs. We include 
in [y*], apart from the variables that are already present in [y], all the fe’s 
corresponding to positive answers from the EMQ. Clearly, this constructs y* 
with a linear cost in terms of EMQs. 

EMQ —> SMQ. The same process provides for SMQs. Indeed, a member¬ 
ship query on an assignment x receives a positive answer if and only iix = x*, 
as per Proposition [2l Essentially, membership is negative if and only if there 
exists some variable b not in [x] such that T |= [x] —?■ b. Again, the cost is 
linear. 
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EAdQ-|-EEQ —y SEQ. We should note that this case is just a detailed 
version of Footnote 4 in [^. When answering an SEQ, unless the hypothesis 
is already equivalent to the target, we need to return an assignment that 
satishes the target but not the hypothesis or vice versa. We hrst make an 
EEQ with the hypothesis and in return obtain a clause; from this clause we 
need to hnd an assignment that distinguishes the target from our hypothesis. 
We have two cases: it is a positive counterexample (entailed by the target 
but not by the hypothesis), or it is a negative counterexample (entailed by 
the hypothesis but not by the target). 

The easier case is when the clause produced by the EEQ is positive. We 
transform it into a negative counterexample assignment x as follows. Let 
a —6 be the counterexample clause, so that T entails a ^ b but hyp{N) 
does not. There must be x that satishes hyp{N) but does not satisfy a ^ h, 
so that it cannot satisfy T because of the entailment from T. Such an x is 
what we want. 

How do we actually hnd it? To fail a —)■ 6, it must satisfy a, and also 
all the consequences of a under hyp{N) in order to satisfy hyp{N). The 
closure of [a] under hyp{N) (call it w) will do. Variable b is not in that 
closure because the variables in the closure of a under hyp{N) are exactly 
those variables v for which hyp{N) entails a —?> n, and for n = 6 it is not the 
case. Hence, w fails a ^ b, which is entailed by T, so w cannot satisfy T, 
and satishes hyp{N) because it is a closure under it. So, in order to answer 
the EQ in this case one EEQ is enough and the time complexity is what it 
takes to do forward-chaining with the hypothesis, which can be done (when 
implemented carefully) in linear time in the number of implications in the 
hypothesis and the number of variables j^. 

The remaining case (counterexample clause entailed by the hypothesis 
but not by the target) can in fact be handled in the same way. The only 
difference is that, instead of closing [a] under the hypothesis hyp{N), we close 
it under the target, obtaining [a]* via the simulation of closures by EMQs. 
So, in this case, one EEQ and a linear number of EMQs are needed in the 
worst case. 

As a consequence of the ability of entailment queries to implement both 
CQs and SEQs, from Theorems H] and [8] we obtain: 

Theorem 9. The following statements hold. 

1. Horn theories are learnable from entailment queries in polynomial 
time. 


16 


2. Further, such learning can be done so as to output the GD basis of the 
target. 

4 . 1 . 2 . Closure and Eguivalence Queries Simulate Entailment 
CQ EMQ. A CQ can easily simulate a membership query of the entail¬ 
ment protocol. Given a clause a ^ n, we can hnd out whether the target 
entails it by just asking for the closure of the left-hand side and testing 
whether n G a*. One single CQ suffices. 

CQd-SEQ -)■ EEQ. For the simulation of an equivalence query of entail¬ 
ment, of course we resort to an SEQ; but we must transform the assignment 
we get as counterexample into a counterexample clause for entailment. Given 
a negative counterexample assignment x, use a CQ to obtain x* ^ x and 
choose any variable v that is true in x* but not in x. Then, our counterex¬ 
ample query is [x] v: as x is positive for the query, v is not a consequence 
of [x] for the query, but it is with respect to the target, as n G [x*]. Similarly, 
given a positive counterexample x, that is, therefore, negative for the query, 
we can hnd a counterexample clause [x] ^ n by hnding some v ^ [x] that fol¬ 
lows by forward chaining from [x] using the hypothesis in the query. Besides 
the SEQ, we spend at most one additional CQ in this process. The total 
time would be 0 {nm) (here, m is the implication size of the hypothesis). 

As a corollary, we obtain the following linear reductions among these 
three models: 

Corollary 1. The following statements hold. 

1. CQ-hSEQ EMQ-hEEQ. The entailment and closure learning 
models are eguivalent (up to a linear number of gueries). 

2. E]\/[Q-|-EEQ —y SIVIQ-I-SEQ. Entailment can simulate the standard 
protocol (up to a linear number of gueries). 

3. CQ-|-SEQ —y SlVlQ-l-SEQ. The closure protocol can simulate the 
standard protocol (up to a linear number of gueries). 

It is worth noting that it is also possible to simulate closure queries (CQ) 
with the standard protocol (i.e., SEQ-I-SMQ —)■ CQ) by means of the follow¬ 
ing trivial (polynomial-query) reduction: when asked to compute a closure, 
we invoke the AFP algorithm of and once we discover the target we can 
easily compute the closure. Notice that this takes 0{nm^) queries so a poly¬ 
nomial reduction is indeed possible; however, we would like to see strictly 
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better complexities. By transitivity, we would also obtain the (trivial) re¬ 
duction SEQ-I-SMQ —)■ EEQ-I-EMQ using the same trick. It remains an open 
question whether the reduction SEQ-I-SMQ —>■ CQ can be done with better 
query complexity. 

We can show, however, that having equivalence queries is necessary for the 
reduction to work. That is, if equivalence queries are not available, then the 
reduction SMQ —)■ CQ is not possible with a polynomial number of queries, 
as the following theorem shows: 

Theorem 10. Answering a CQ may require an exponential number of SMQs. 

Proof. Let be a family of Horn theories: iF = {fx\x G {0,1}"',x 7 ^ 1"} 
where fx is the conjunction of two parts: 

/x= /\(„^ir|) 

w^[x] 

The hrst half of fx guarantees that any satisfying assignment y is such that 
X < y, the second half guarantees that no assignment y such that x < ?/ < 1 " 
satishes fx- Thus, each fx is satished by exactly two assignments: x itself 
and the top 1 ". 

Now, we want to answer a CQ for the assignment 0". For an arbitrary 
target fx G F, the answer should be x. But obviously we do not know what 
the target is and we need to answer the closure query by means of querying 
the standard membership query oracle. Answering the closure query correctly 
corresponds to identifying the target function f^ among all candidates in F 
(of which there are 2" — 1). We use an adversarial strategy to show the 
exponential lower bound: all the answers to any membership query are going 
to be negative unless the input assignment to the query is 1". Each query 
rules out only one potential target function and thus an exponential number 
of queries is needed. □ 

In fact. Theorem [To] hts the general lower bounding scheme described in 
Lemma 2 of [H. As a corollary we obtain that EMQs cannot be simulated 
with a polynomial number of SMQs either. 

Corollary 2. Answering an EMQ may require an exponential number of 
SMQs. 
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Query simulation 

Query complexity 

Time complexity 

SMQ ^ EMQ 

0 (2") 

0 (2") 

SMQ ^ CQ 

0 (2") 

0 (2") 

EMQ ^ CQ 

0 (n) 

0 (n) 

EMQ ^ SMQ 

0 (n) 

0 {n) 

CQ ^ EMQ 

1 

0 (n) 

CQ ^ SMQ 

1 

0 (n) 

SEQ+CQ ^ EEQ 

1SEQ + 1CQ 

0 {nm) 

EEQ+EMQ ^ SEQ 

1 EEQ + 0(n) EMQ 

0 {nm) 


Table 1: Relationship between different queries. As it is customary, n stands for the num¬ 
ber of propositional variables; m stands for the implicational size of the input hypothesis. 


Algorithm 

Query complexity 

Time complexity 

AFP 

LRN 

CIH 

0{nHn) SMQs & 0{mn) SEQs 
0{m^n) EMQs & 0(mn) EEQs 
0{rn?n) CQs & 0{mn) SEQs 

0 {mSn^) 

0 {mSn^) 

Oijn^n^) 


Table 2: Query complexity and time complexity for AFP, LRN and CIH. 

Table [U summarizes the results from this section. 

Additionally, Table [2] summarizes the query and time complexities of the 
three algorithms that we compare in this paper for learning dehnite Horn 
theories. Note that while the worst-case complexities are the same for the 
three algorithms, there are cases where LRN and CIH are going to be running 
faster than AFP, due to their slightly more powerful query models. 

4-2. Algorithm Run Simulation 

In this section we deal with the two remaining cases in which, as far as 
we know, the queries are not directly simulable (that is, not without learning 
the target hrst). We show that the full runs “are”, in the sense that a run of 
one algorithm is embedded in some run of the other. 

Namely, each of the algorithms that we consider here, even on the same 
target, may exhibit different runs. More precisely, runs differ among them in 
which counterexamples are provided, and in which order. 
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4-2.1. AFP Runs that Mimic CIH Runs 

In the original membership and equivalence queries protocol, the AFP 
algorithm is not guaranteed to receive only negative counterexamples. The 
reason is the lack of the closure query, that provides us with positive exam¬ 
ples. 

In fact, each run of CIH can be mimicked through a run of AFP as 
follows. Fix the run of CIH that receives the sequence of counterexamples 
xi,X 2 , ■ ■ ■ ,Xk. We construct inductively a specihc run of AFP that will receive 
this sequence of negative counterexamples in the same order, plus positive 
ones as needed in between them. Consider the situation where it has just 
received the j-th of them, with j = 0 corresponding to the start of the al¬ 
gorithm. The rehnement process is the same in both cases, where the tests 
for positive intersections are made via closures in one algorithm and through 
direct memberships in the other. However, at the point of constructing the 
query, one of the antecedents is either new, or newly rehned. For the rest, 
inductively, the closures are the same as in the previous query, but AFP does 
not have available the closure of the changed antecedent in order to use it as 
consequent. It assumes the strongest possible consequent (or, in the variant 


m 
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the strongest consequent compatible with positive examples seen so 
far, so as to avoid the same counterexample to show up over and over). In 
the specihc run we are constructing, let i/i be the newly obtained antecedent. 
AFP might happen to hit upon y* on the basis of its available information: 
then, it is asking exactly the next query of the CIH run. Otherwise, it is 
proposing too large a consequent for yf. then, we give AFP the positive coun¬ 
terexample [y*], which fails the yi clause yet is positive, because it is a closure. 
After this positive example, again the next query is exactly CIHA query. In 
either case, AFP proceeds and gets the j + 1 negative counterexample. 

Note that, along the way, a full formalization of this simulation (which 
we consider unnecessary, as the intuition is clearly conveyed) would provide 
an alternative proof of Theorem |8l as we get that every equivalence query 
(including its output) made by CIH is also a query made in some run of 
AFP on the same target, and it is proved in 1^ that all queries of AFP are 
saturated. 


Query complexity. Looking closely at the closure queries made by CIH, we 
note that they can be of two types: those that are issued to hnd out the “right 
consequent” of a newly added or updated implication in hyp{N), and those 
that are issued to check whether the intersections of negative counterexam- 
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pies are positive or not (line 6 of Algorithm [T]) . If CIH makes a SEQs, then 
a + b closure queries are made: a accounting for the former type (consequents 
of implications), and b for the latter type. So CIH issues a SEQs an a+6 CQs. 
Then, the corresponding run of AFP will make at most 2a SEQs (since we 
may need to feed all closures of antecedents as positive counterexamples in 
order to guide the algorithm towards the “correct consequents”) and b SMQs 
corresponding to checking the “sign” of interesections in order to know what 
antecedent to update. So, both runs have the same total complexity, namely 
2a + b, although CIH uses extra CQs to save on SEQs. 

Of course, our discussion so far only applies to specihc runs of AFP con¬ 
structed in that particular way. However, the properties of AFP proved in 
[l^ show that all runs need to, eventually, identify the proper closures; in 
general, these necessary positive counterexamples may not come at the place 
we are placing them, but instead can come later; and, instead of the closures 
[yf\ that reduce the right-hand sides at once, we may reduce them one bit at 
a time through several positive counterexamples. However, in a somewhat 
loose sense, we can say that AFP is implementing the closure queries through 
potentially shuffled batches of positive counterexamples. This complicated 
procedure, whose most relevant property is actually the goal of obtaining 
closures, makes us expect that progress on the understanding of AFP, and, 
hopefully, either a proof of optimality or an improvement of its query com¬ 
plexity, could be obtained indirectly as a byproduct of the study of our 
simpler, but essentially equivalent, algorithm CIH. 

4-2.2. AFP Runs that Mimic Entailment Runs of LRN 

A similar development can be provided for mimicking runs of the Learning 
from Entailment algorithm. We refrain from getting into too much details 
here, as that would require, among other explanations, to review fully here 
the algorithm from . However, for the beneht of the reader who knows, or 
plans to study soon, that algorithm, we briefly point out how the simulation 
goes; it is quite similar to the one in the previous subsection. 

Fix the run that receives the sequence of counterexample clauses ai ^ xi, 
02 —)■ X 2 , ..., afc —t Xfc. We construct inductively a specihc run of AFP that 
will receive a sequence of negative counterexamples, each corresponding, in 
a precise sense, to each of these clauses. More precisely, consider assignment 
Wi dehned as the closure of [a*] under the Ath hypothesis, to which ccj Xi 
itself is a counterexample. Being a closure under the hypothesis, Wi is positive 
for it; however, it does not have variable Xj set to 1, because the clause is 
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not entailed by the hypothesis, and this makes it a negative counterexample, 
because the clause is entailed by the target. 

Again, each rehnement process is identical in both algorithms, so the dif¬ 
ference is again upon constructing the new query. The entailment algorithm 
can use entailment memberships to hit the correct right-hand side. Instead, 
we consider a run of AFP as before, where the appropriate positive coun¬ 
terexamples are provided right away to lead the algorithm to the correct next 
query of the simulated entailment run. 

Again, we consider unnecessary to provide a full formalization of this 
simulation. However, since, again, all queries of AFP are saturated [l^, we 
note that from such a full formalization we can obtain a slightly stronger 
version of Theorem 0 in fact, the LRN algorithm already constructs the 
GD basis of the target, because every equivalence query there, including its 
output, is also a query made in some run of AFP on the same target. 

5. Related Open Problems 

We would like to study how to extend our result to general Horn func¬ 
tions; the main difficulty being that it is not clear what closure means in the 
general case. In our previous work [l^ we come up with a pwm-reduction 
that makes learning possible for general Horn under the model of standard 
equivalence and standard membership queries. It is left for future work to 
study a new reduction that works under the closure query model. 

It also remains to prove or disprove the following relationships: 

• EMQ cannot be obtained with a linear number of SMQs and SEQs; 

• CQ cannot be obtained with a linear number of SMQs and SEQs; 

• EEQ cannot be obtained with a polynomial number of SEQ; 

• SEQ cannot be obtained with a polynomial number of EEQ. 

Acknowledgment s 

The authors are grateful to Montse Hermo for useful discussions. We 
thank also the anonymous reviewers for their careful reading and thoughtful 
remarks, which have helped very much in improving the paper. 


22 


References 

[1] D. Angluin, Queries and concept learning, Machine Learning 2 (4) (1987) 
319-342. 

[2] D. Angluin, M. Kharitonov, When won’t membership queries help?. 
Journal of Computer and System Sciences 50 (2) (1995) 336-355. 

[3] J. L. Balcazar, J. Castro, D. Guijarro, J. Kobler, W. Lindner, A general 
dimension for query learning, J. Comput. Syst. Sci. 73 (6) (2007) 924- 
940. 

[4] D. Angluin, M. Frazier, L. Pitt, Learning conjunctions of Horn clauses. 
Machine Learning 9 (1992) 147-164. 

[5] S. A. Goldman, S. Kwek, S. D. Scott, Learning from examples with 
unspecihed attribute values. Inf. Comput. 180 (2) (2003) 82-100. 

[6] S. Ben-David, E. Dichterman, Learning with restricted focus of atten¬ 
tion, in: COLT, 1993, pp. 287-296. 

[7] M. Frazier, L. Pitt, Learning from entailment: An application to propo¬ 
sitional Horn sentences, in; ICML, Morgan Kaufmann, 1993, pp. 120- 
127. 

[8] B. Canter, Attribute exploration with background knowledge, Theor. 
Comput. Sci. 217 (2) (1999) 215-233. 

[9] L. Becerra-Bonache, A. H. Dediu, C. Tirnauca, Learning DFA from 
correction and equivalence queries, in; Y. Sakakibara, S. Kobayashi, 
K. Sato, T. Nishino, E. Tomita (Eds.), ICGI, Vol. 4201 of Lecture Notes 
in Computer Science, Springer, 2006, pp. 281-292. 

[10] C. Tirnauca, A note on the relationship between different types of cor¬ 
rection queries, in: A. Clark, F. Coste, L. Miclet (Eds.), ICGI, Vol. 5278 
of Lecture Notes in Computer Science, Springer, 2008, pp. 213-223. 

[11] C. Tirnauca, Language learning with correction queries, Ph.D. thesis, 
Rovira i Virgili University, Tarragona, Spain (2009). 


23 


[12] C. Tirnauca, S. Kobayashi, Necessary and sufficient conditions for learn¬ 
ing with correction queries, Theor. Coniput. Sci. 410 (47-49) (2009) 
5145-5157. 

[13] M. Arias, J. L. Balcazar, Canonical Horn representations and query 
learning, in: R. Gavalda, G. Lugosi, T. Zeugmann, S. Zilles (Eds.), 
ALT, Vol. 5809 of Lecture Notes in Computer Science, Springer, 2009, 
pp. 156-170. 

[14] M. Arias, J. L. Balcazar, Construction and learnability of canonical Horn 
formulas. Machine Learning 85 (3) (2011) 273-297. 

[15] A. Horn, On sentences which are true of direct unions of algebras, J. of 
Symbolic Logic 16 (1956) 14-21. 

[16] J. McKinsey, The decision problem for some classes of sentences without 
quantihers, J. Symbolic Logic 8 (1943) 61-76. 

[17] R. Khardon, D. Roth, Reasoning with models, Artihcial Intelligence 
87 (1-2) (1996) 187- 213. 

[18] H. Kleine Biining, T. Lettmann, Propositional logic: deduction and 
algorithms, Cambridge University Press, 1999. 

[19] J. Guigues, V. Duquenne, Families minimales d’implications informa- 
tives resultants d’un tableau de donnees binaires. Math. Sci. Hum. 95 
(1986) 5-18. 

[20] D. Maier, Minimum covers in relational database model, J. ACM 27 
(1980) 664-674. 

[21] M. Wild, A theory of hnite closure spaces based on implications. Ad¬ 
vances in Mathematics 108 (1994) 118-139. 

[22] W. F. Dowling, J. H. Gallier, Linear-time algorithms for testing the sat- 
ishability of propositional Horn formulae, J. Log. Program. 1 (3) (1984) 
267-284. 


24 


